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1  Summary 


The  funds  received  under  Grant  AFOSR-86-01-316,  “Research  Instrumentation  for  Computer 
Vision,  Image  Understanding  and  Optical  Computing,”  went  for  the  purchase  of  equipments  in 
support  of  several  current  AFOSR  funded  research  projects  at  USC.  These  projects  include:  Im¬ 
age  Processing  and  Computer  Vision,  Optical  Symbolic  and  Neural  Computing  and  Nonlinear 
Optical  Information  Processing.  The  equipment  purchased  consists  of  the  following  components: 
SUN  3/160  workstation,  2  SUN  3/110  workstations,  memory  boards  and  floating  point  acceler¬ 
ators,  a  Microvax  II  dedicated  host  computer,  TI  Explorer  II  AI  workstation.  The  equipment 
acquired  has  greatly  improved  research  productivity  in  the  projects  listed  by  providing  up-to-date 
hardware  and  software  capable  of  performing  advanced  experimental  projects  which  could  not  be 
done  on  previously  available  equipments. 


2  Research  Progress 

This  section  summarizes  research  progress  and  accomplishments  for  the  period  1  September  1986- 
28  February  1988  on  AFOSR-86-0316  for  Research  Instrumentation  for  Computer  Vision,  Image 
Understanding  and  Optical  Computing.Funds  received  on  this  grant  went  for  the  purchase  of 
equipments  in  support  of  several  current  AFOSR  funded  research  projects  at  USCVThe  projects 
are  very  closely  related  and  are  specifically: 

•  Image  Processing  and  Computer  Vision 

•  Optical  Implementation  of  Neural  Networks  for  Computer  Vision 

•  Nonlinear  Optical  Information  Processing 

•  Optical  Symbolic  Computing 


Common  to  all  these  areas  of  research  is  the  need  for: 


•  Extensive  numerical  simulation  and  modeling  of  devices,  processors  and  systems. 

•  Computationally  intensive  transforming  and  analysis  of  algorithms  performed  on  large  ar¬ 
rays  of  image  and  other  multidimensional  data. 

•  Solution  of  optimization  problems  involving  multidimensional  nonlinear  equations. 

•  Interframe  processing  between  several  arrays  of  image  data. 

•  Interactive  display,  manipulation  and  plotting  of  images  and  graphic  representations  of  the 
results. 
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The  equipment  purchased  consists  of  an  interactive  display/computing  system  with  the 
following  components. 


•  SUN  3/160  workstation:  16MB  memory,  280  disk,  FPA;  LISP,  image  processing,  optimiza¬ 
tion,  scientific  subroutine. 


•  SUN  3/110  workstations  connected  to  a  SUN  3/280  server,  12  MB  MEMORY,  FPA; 
Rochester  connectionist  Simulator. 


•  DEC  Microvax  II  workstation:  with  9  MB  memory,  280  MB  disk,  8  terminal  lines,  ethernet 
interface  and  a  cartridge  tape  mount. 

•  TI  Explorer  II  AI  workstation:  with  16  MB  memory,  540  MB  disk  and  network  interfaces. 
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The  following  is  a  complete  list  of  items  purchased  under  this  grant  and  their  price. 


ITEM 

QUANTITY 

COST 

1.  SUN  3/ 110G  Workstation 

2 

$22, 446.81 

2.  SUN  3/160G  Workstation  with 

280  MB  software  and  license 

1 

40,219.06 

3.  Toshiba  510  MB  disk  with  panel 
and  Controller 

1 

3,509.80 

4.  DEC  -  Microvax  -  II  Work 
station,  ethernet  interface 

1 

37,777.39 

5.  DEC  -  Unix  32  M 

1 

2,609.33 

6.  8  MB  Memory  Board  for  SUN  3 

computers 

3 

8,393.85 

7.  Floating  point  accelerators  for 

SUN  3  computers 

2 

6,789.05 

8.  Texas  Instruments  Explorer-II 
Workstation  with  16  MB  memory 
540  MB  disk,  ethernet  interface 

1 

28,992.27 

Total  = 

$150,737.56 

AFOSR  Funds 

$132,000.00 

USC  Funds 

$18,737.56 

I 

i 

1 
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The  system  acquired  has  greatly  improved  research  productivity  in  the  projects  listed  by  provid¬ 
ing  up-to-date  equipment  capable  of  performing  the  experimental  tasks  described.  The  enhanced 
research  environment  afforded  by  the  system  has  enabled  many  new  experimental  projects  to  be 
performed  which  could  not  be  done  on  previous  equipment.  The  results  are  discussed  separately 
in  the  sections  that  follow. 


2.1  Research  in  Computer  Vision 

R.  Chellappa,  Principal  Investigator 
Support:  Research  in  Electronics  (JSEP), 

AFOSR  contract  F  -  49620-85-C-0071 
Dr.  Gerald  Witt,  AFOSR/NE,  Technical  Monitor 

The  goal  of  this  research  project  is  to  develop  robust  intelligent  algorithms  for  the  interpretation 
of  visible  and  SAR  aerial  images.  During  the  last  two  years,  robust  stochastic  model  based  algo¬ 
rithms  have  been  developed  for  the  extraction  of  edges,  corners,  lines,  textures  and  topographical 
descriptors  from  visible  images.  Using  the  reflectance  models  for  SAR  images  and  auxiliary  low 
resolution  altimetry  data,  high  resolution  terrain  maps  have  been  extracted  from  SAR  images. 
Implementations  of  these  algorithms  were  done  on  the  equipment  purchased  under  this  grant.  In 
the  next  three  years,  these  efforts  will  be  extended  to  develop  a  knowledge  based  image  analysis 
system  for  the  intelligent  interpretation  of  visible  and  SAR  images.  Emphasis  will  be  on  detecting 
man  made  objects. 


2.2  Nonlinear  Real-Time  Optical  Signal  Processing 

A. A.  Sawchuk,  Principal  Investigator 
Support:  AFOSR  Grant  AFOSR-84-0181 
Dr.  Lee  Giles,  AFOSR/NE,  Technical  Monitor 

During  the  period  1  September  1986  -  28  February  1988,  the  research  under  the  above  grant  has 
been  concerned  with  various  aspects  of  optical  digital  computing.  In  this  period  we  have  con¬ 
centrated  on  hardware  and  software  implementations  of  digital  optical  cellular  image  processing. 
We  have  developed  binary  image  algebra  (BLA),  comprised  of  five  elementary  images  and  three 
fundamental  operations  (complement,  union  and  dilation)  that  serves  as  a  mechanism  to  define 
parallel  binary  image  processing  algorithms.  A  hardware  design  called  DOCIP  (digital  optical 
cellular  image  processors),  derived  from  cellular  automata  and  cellular  logic  architectures  has 
been  developed.  DOCIP  is  ideally  matched  to  the  parallel  software  developed  from  BIA,  and 
is  well-suited  to  parallel  implementation  on  a  parallel  digital  optical  computer.  DOCIP  systems 
having  nearest  neighbor  connections  and  hypercube  connections  have  been  defined  and  compar¬ 
isons  of  their  capabilities  are  being  made. 
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2.3  Optical  Symbolic  and  Neural  Computing 

B.  K.  Jenkins,  Principal  Investigator 
Support:  AFOSR  Grant  86-0196 
Dr.  Lee  Giles,  AFOSR/NE,  Technical  Monitor 

We  have  developed  a  new  learning  algorithm,  potential  difference  learning,  for  self  organiz¬ 
ing  neural  networks.  It  updates  the  weights  in  proportion  to  the  correlation  of  the  presynaptic 
signal  with  the  temporal  difference  of  the  postsynaptic  potential.  It  can  learn  on  the  basis  of 
temporal  differences  of  input  patterns  or  on  the  basis  of  absolute  patterns.  We  have  simulated  it 
on  a  Hopfield  or  Amari  net  and  on  a  three  layer  net.  The  three  layer  net  consists  of  two  Amari 
nets  connected  by  a  hidden  layer;  the  hidden  layer  serves  to  associate  patterns  that  are  stored 
in  the  two  visible  layers.  We  have  also  shown  how  it  can  be  used  for  unlearning  or  erasing  a 
particular  stored  pattern  in  an  Amari  net,  merely  by  inputting  patterns  in  a  presrcibed  sequence: 
direct  access  to  the  weights,  and/or  reversing  the  sign  of  the  learning  gain,  is  not  necessary.  We 
have  also  described  an  optical  architecture  for  the  implementation  of  potential  difference  learning. 

We  have  developed  a  technique  for  subtracting  incoherent  optical  signals  using  all-optical 
devices,  called  an  incoherent  optical  neuron  (ION)  model.  This  permits  a  neural  net  to  be  im¬ 
plemented  with  all-optical  devices,  even  if  it  has  positive  and  negative  synaptic  weights,  and 
excitatory  and  inhibitory  inputs.  It  is  generic  in  that  it  can  be  used  in  both  fully  or  partially 
connected  networks,  multi-layer,  single-layer,  feedforward  or  recurrent  networks,  using  analog 
(sigmoid)  or  binary  neurons  units.  It  assumes  conventional  inner-product  type  neuron  units.  We 
have  simulated  the  model  for  imperfect  device  responses,  on  an  on-center  off-surround  competi¬ 
tive  neural  net.  We  have  found  that  it  is  fairly  forgiving  of  device  imperfections,  nonuniformities, 
and  noise. 

We  have  also  investigated  complexity  issues  regarding  optical  computing.  A  model  for  digital 
optical  computing  systems  was  derived  that  is  analogous  to  common  VLSI  complexity  models. 
It  was  found  that  in  optics  the  area-time  tradeoff  becomes  a  volume-time  tradeoff  and  permits 
essentially  any  amount  of  information  transfer  in  any  time  step  of  the  computation.  Further, 
because  the  information  transfer  (that  is,  the  interconnection  capability)  does  not  give  a  limit 
on  the  computing  power  of  optical  systems,  a  realistic  complexity  model  must  characterize  the 
factors  that  will  limit  the  computing  capability.  Such  a  model  would  be  very  different  from  that 
in  electronics,  because  in  electronics  all  VLSI  complexity  models  are  derived  from,  and  focus 
essentially  exclusively  on,  interconnection  limitations. 


3  Written  Publications 

During  the  period  1  September  1986  through  28  February  1988,  a  number  of  papers  based  on 
this  research  have  been  published.  A  list  of  these  follows: 


[lj  K.  S.  Huang,  B.  K.  Jenkins  and  A.  A.  Sawchuk,  “  Binary  Image  Algebra  and  Optical 
Cellular  Logic  Design,”  submitted  to  Computer  Vision,  Graphics,  and  Image  Processing. 

[2]  K.  S.  Huang,  B.  K.  Jenkins  and  A.  A.  Sawchuk,  “An  Image  Algebra  Representation  of 
Parallel  Optical  Binary  Arithmetic,”  submitted  to  Applied  Optics. 

[3]  K.  S.  Huang,  B.  K.  Jenkins  and  A.  A.  Sawchuk,  “  Programming  a  Digital  Optical  Cellular 
Image  Processor,”  Optical  Society  of  America  Annual  Meeting,  Rochester,  NY.  October 
1987,  J.  Optical  Soc.  Amer.  .4.,  Vol  4,  pp.  87-88,  1987. 

[4]  K.  S.  Huang,  B.  K.  Jenkins,  and  A.  A.  Sawchuk,  “Binary  Image  Algebra  Representations 
of  Optical  Cellular  Logic  and  Symbolic  Substitution,”  Optical  Society  of  America  Annual 
Meeting,  Rochester,  NY,  October  1987;  J.  Optical  Soc.  Amer.  A.,  Vol.  4.  pp.  87-88.  1987. 

[5]  K.  S.  Huang,  B.  K.  Jenkins,  A.  A.  Sawchuk,  “A  Cellular  Hypercube  Architecture  for  Image 
Processing,”  Proceedings  Society  of  Photo-Optical  Instrumentation  Engineers  Technical 
Symposium- Applications  of  Digital  Image  Processing,  SPIE  Vol.  829.  San  Diego.  August 
1987. 

[6]  K.  S.  Huang,  B.  K.  Jenkins  and  A.  A.  Sawchuk,  “Optical  Cellular  Logic  Architectures 
Based  on  Binary  Image  Algebra,”  Proc.  JEFF,  Computer  Society  Workshop  on  Computer 
Architectures  for  Pattern  Analysis  and  Machine  Intelligence ,  Seattle,  WA.,  October  1987. 

[7]  B.  K.  Jenkins  and  A.  A.  Sawchuk,  “Binary  Optical  Computing  Architectures,”  Optics  News 
Vol  12,  No.  4,  pp.  25-26,  (April  1986). 

[8]  A.  Armand,  T.  C.  Strand  and  A.  A.  Sawchuk,  “Nonlinear  Optical  Processing  and  Halftones; 
Accurate  Predictions  for  Degradation  end  Compensation”.  Applied  Optics,  vol.  26,  pp. 
1007-1014,  (15  March  1987). 

[9]  K.  S.  Huang,  B.  K.  Jenkins  and  A. A.  Sawchuk,  “Binary  Image  Algebra  and  Digital  Opti¬ 
cal  Cellular  Processors,”  Technical  Digest ,  Topical  Meeting  on  Optical  Computing,  Optical 
Society  of  America,  Incline  Village,  NV,  March  16-18,  1987. 

[10]  R.  T.  Frankot  and  R.  Chellappa,  “Lognormal  Random  Field  Models  and  Their  Applica¬ 
tions  to  Radar  Image  Synthesis,”  IEEE  Transactions  Geoscience  and  Remote  Sensing ,  vol. 
GE-24.  pp.  195-207,  March  1987. 

[11]  C.  C.  Lin  and  R.  Chellappa,  “Classification  of  2-D  Partial  Shapes  Using  Fourier  Descrip¬ 
tors,”  IEEE  Trans.  Patt.  Anal.  Mach.  Intell ,  vol.  PAMI-9,  PP.  686-690,  September  1987, 


[12]  R.  Hansen,  Jr.  and  R.  Chellappa,  uTwo  Dimensional  Robust  Spectral  Estimation,”  (To 
appear  -  IEEE  Trans.  Acoust.,  Speech  and  Signal  Proc .),  July  1988. 

[13]  Y.  T.  Zhou.  R.  Chellappa,  B.  K.  Jenkins  and  A.  Vaid,  “Image  Restoration  Using  a  Xeural 
Network.”  (Accepted  for  Special  Issue  on  Neural  Networks.  IEEE  Trans.  Acoust..  Speech 
and  Signal  Processing ,  July  1988). 

[14]  Y.  T.  Zhou.  A.  Rangarajan  and  R.  Chellappa,  “A  Unified  Approach  for  Filtering  and  Edge 
Detection  in  Noisy  Images”,  (Submitted  for  publication). 

[15]  T.  Simchonv.  R.  Chellappa,  J.  Hao,  and  Z.  Lichtenstein.  "A  Stochastic  Relaxation  Algo¬ 
rithm  for  the  Restoration  Array  Level  Images  Completed  by  Multiplicative  and  Poisson 
Noise,”  (Submitted  for  Publication). 

[16]  T.  Simchony  and  R.  Chellappa,  “Stochastic  and  Deterministic  Algorithms  for  Texture  Seg¬ 
mentation,”  (Submitted  for  Publication). 

[17]  G.  S.  Young  and  R.  Chellappa,  “3-D  Motion  Estimation  Using  a  Sequence  of  Noisy  Stereo 
Images:  Models,  Motion  Estimation  and  Uniqueness  Results.”  (Submitted  for  Publication). 

[18]  T.  Simchony  R.  Chellappa,  and  S.  Min,  “Direct  Analytical  Methods  for  Solving  Poisson 
Equations  in  Computer  Vision  Problems,”  (Submitted  for  Publication). 

[19]  R.  T.  Frankot  and  R.  Chellappa,  “Estimation  of  Surface  Topography  from  SAR  Images 
Using  Shape  from  Shading,”  (Submitted  for  Publication). 

[20]  T.  J.  Broida  and  R.  Chellappa,  “Estimating  Kinematics  and  Structure  of  a  Rigid  Object 
from  a  Sequence  of  Noisy  Monocular  Images,”  (Submitted  for  Publication). 

[21]  R.  Chellappa,  “Model  Based  Approaches  for  Some  Image  Understanding  Problems,”  Proc- 
SPIE ,  Los  Angeles,  January  1987.  (Invited  Paper) 

[22]  R.  Chellappa,  T.  Simchony  and  H.  Jinchi,  “Relaxation  Algorithms  for  MAP  Restoration 
of  Gray  Level  Images  with  Multiplicative  Noise”,  Conf.  Inform.  Sciences  and  Systems. 
Baltimore,  MD,  March  1987. 
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[23]  V.  T.  Zhou,  A.  Rangarajan.  and  R.  Chellappa,  “A  Unified  Approach  for  Filtering  and  Edge 
Defection  in  Noisy  Images”,  Proc.  21st  Annual  .isilomar  Con},  on  Systems,  Signals,  and 
Computers.  Monterey,  CA.,  November  1987. 


[24]  R.  T.  Frankot  and  R.  Chellappa,  “Application  of  a  Shape  from  Shading  Technique  to  Syn¬ 
thetic  Aperture  Radar  Imagery.”  Inti.  Geoscience  and  Remote  Sensing  Symposium.  Ann 
Arbor.  MI,  May  1987. 


[25]  Y.  T.  Zhou  and  R.  Chellappa.  “Linear  Texture  Extraction  Based  on  an  AR  Model  Edge 
Detector."  Inti.  Con}.  Acoustics.  Speech  and  Signal  Proc..  Dallas.  Texas.  April  1987. 


[26]  Y.  T.  Zhou,  R.  Chellappa.  and  G.  Bekey,  "Estimation  of  Filtering  Properties  of  Living 
Tissues  for  Inverse  Filtering  of  Surface  EMG  Signals.”  Inti.  Con}.  Acoustics ,  Speech  and 
Signal  Proc..  Dallas,  Texas.  April  1987. 


[27]  R.  T.  Frankot  and  R.  Chellappa,  "A  Method  for  Enforcing  Integrability  in  Shape  from 
Shading  Problems.”  First  Inti.  Con},  on  Computer  Vision.  London.  June  1987. 

[28]  Y.  T.  Zhou.  R.  Chellappa  and  B.  K.  Jenkins.  "A  Novel  Approach  to  Image  Restoration 
Based  on  a  Neural  Network.”  First  Annual  Inti.  Con},  on  Neural  Networks,  San  Diego. 
CA.  June  1987. 


[29]  R.  Hansen  Jr.  and  R.  Chellappa,  “2-D  Spectrum  Estimation  for  Imperfectly  Observed 
Lattice  Data.”  Inti  Con}.  Acoust..  Speech  and  Signal  Proc.  Dallas.  Texas.  April  1987. 


[30]  D.  S.  Kalivas,  A.  A.  Sawchuk,  and  R.  Chellappa,  "Estimation  and  Segmentation  of  Image 
Sequences,”  Proc.  SPIE  Conference.  San  Diego,  CA,  August  1987. 


[31]  C.  H.  W'ang  and  B.  K.  Jenkins,  “Potential  Difference  Learning  and  Its  Optimal  Design.” 
Proc.  SPIE,  vol.  882,  January  1988. 


[32]  B.  K.  Jenkins  and  C.  H.  Wang,  “Model  for  an  Incoherent  Optical  Neuron  that  Subtracts,” 
(Submitted  for  Publication). 
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4  Professional  Personnel  and  Advanced  Degrees 

The  following  individuals  contributed  to  the  research  efforts  supported  by  this  grant: 

Dr.  Rama  Chellappa,  Associate  Professor  of  Electrical  Engineering,  Principal  Investigator. 

Dr.  Alexander  A.  Sawchuk.  Professor  of  Electrical  Engineering,  Director,  Signal  and  Image  Pro 
cessing  Institute.  Senior  Investigator 

Dr.  Brian  K.  Jenkins,  Assistant  Professor  of  Electrical  Engineering,  Senior  Investigator 
Dr.  Allan  Weber,  Manager,  Signal  and  Image  Processing  Institute,  USC 

Kung-Shiuh  Huang,  Research  Assistant,  Ph.D  candidate.  Department  of  Electrical  Engineering 
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